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Let X1,¥1, X2, Yo,..., Xn, Yn € {0,1/2,1} be the outcomes of a match between 


two chess engines. The openings of X1,...,X, are picked from an opening book 
and Yj,..., Yn are played with the same openings but with reversed colors. We put 
Mi = E(Xi), 
po = BM). 


The match score is defined as 


2a 2n 


In the trinomial model the (X;);, (Yi); are (incorrectly) considered as i.i.d random 
variables. The trinomial model leads to the following (also incorrect) estimate for 
the variance of the match score 


1 (X1 — $)* + (Yi — 8)? +--+ + Xn — 8)? + (Yn = 8)? 


Varg (S) = on on 


In the (more correct) pentanomial model we put Z; = (X; + Y;)/2. We have 


Zt t+ Zn 
- n 


S 


and, assuming the (Z;); are independent random variables with identical expecta- 
tion values, the pentanomial estimate for the variance of S' is 


Var5(s) = 4A BS)? pee (Ze sy 


(X, — S)?+(% — S)? +--+ + (X, — S)? +(¥, - 8)? 
2n 


V3 := 2n Var3(5'}) = 


whereas the pentanomial variance, normalized per game is 


(21 — 8)? +--+ (ZnS)? 


n 


V5 := 2n Vars(S') = 2 


Assuming small elo differences, and additivity of elo, we have 


Mi=s rs bi, 
(0.1) — b. 
Hi = $— 9%. 
where 0; is the bias of the z’th opening position and s is de expected match score 
for balanced positions between the given engines. 
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Theorem 0.1 (The accounting identity). Assume that the 2n random variables 
(X;)i, (Vi)i are independent and that additivity of elo in the sense of (0.1) holds. 
Then under reasonable regularity conditions on (14i)i, (uP); we have 


1 
2 = b? + O(n7*/?). 
(0.2) V3 — Vs nob mee) 


We call (0.2) an accounting identity since it basically amounts to rewriting some 
sums. 


Assuming that the opening positions are picked randomly and 6 is the random 
variable representing the bias of a position, the formula (0.2) may be rewritten as 


V3 — V5 = E(t?) + O(n-/?), 
We call 
E(b?) 
(possibly converted to Elo for clarity) the RMS bias of an opening book. 
Proof of Theorem 0.1. We have 


Ge GVA won Zn — 8)? 
Sine eee A a) 


n 
— (X41 +¥, - 28)? +--+ + (Xn +¥, — 28)? 
= Qn , 
Hence 
wavs (X1 _ ae + (Yi Ss)? (X1 + Yy 25)? + 
2n 
(ApS) = 9) et = BGS) 
n 
We have 
(X;,-5)\(%—S) = GY, - (+ ¥)S+S? 
DECK — $)(¥i - 8) = DIY — SUG + Yi) +08? 
= ye XiY; — 2nS? + ns? 
=> X.Y; - ns? 
and hence 
XY; 
V3 Vs = dad ae 52. 


By the central limit theorem we have 
S = E(S)+ O(n-/?) 
so that (assuming reasonable (ju;);, (142)a) 


S? = B(S)? + O(n-"/?), 
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The random variables X,Y; are independent but not identically distributed. Nonethe- 
less, under very weak hypothesis [1], we may assume that the central limit theorem 
applies, so that 
XY; E( XY; i 
i = a ( ) + O(n nh) 


Thus . ‘. 
V3-Vs= mF EAE) 4 E(8)? ae O(n-"/?) 
_ _ DEM) = EIS)(EW) = ES) 5 G¢y-1/2) 
= Balk of O(n-/?) 
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